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THIS study tested THE HYPOTHESES THAT ONE SCHOOL IN A 
COLLEGE MAY BE EASIER THAN OTHERS IN THE SAME INSTITUTION, 

AND THAT STUDENTS IN ACADEMIC DIFFICULTY IN OTHER SCHOOLS 
WILL transfer to THE EASIER SCHOOL IN CRDER TO GRADUATE. THE 
study was CONCERNED PRIMARILY WITH A LARGE SOUTHEASTERN 
COLLEGE WITH 12 SCHOOLS. DATA INCLUDED COLLEGE BOARD 

APTITUDE TEST SCORES, HIGH SCHOOL AVERAGE GRADES, 
AND freshman AVERAGE GRADES OF THE 1,02S FRESHMEN WHO 
COMPLETED 40 HOURS OF WORK IN JUNE 1965. COMPUTER PROCESSING 
WAS PERFORMED FOR DOTH ANALYSIS OF COVARIANCE AND MULTIPLE 
DISCRIMINANT FUNCTION ANALYSIS. COMPARAIIVE DATA WERE 
ANALYZED FROM THREE SMALLER INSTITUTIONS— A NEGRO 
COEDUCATIONAL COLLEGE, A 4-YEAR WOMEN'S LIBERAL ARTS COLLEGE, 
AND A 2-YEAR COEDUCATIONAL JUNIOR COLLEGE. A RELATIVELY SMALL 
STATISTICALLY SIGNIFICANT DIFFERENCE WAS FOUND TO EXIST IN 
GRADING PRACTICES AMONG THE SEVERAL SCHOOLS OF THE LARGE 
COLLEGE, nullifying THE HYPOTHESIS THAT STUDENTS IN ACADEMIC 
DIFFICULTY WILL TRANSFER TO THE EASIER SCHOOL. SIGNIFICANT 
DIFFERENCES IN STUDENT ACADEMIC ABILITY WERE FOUND AMCNG THE 
FOUR separate COLLEGES. ON THE BASIS OF GRADES IN RELATION TO 
APTITUDE, THEREFORE, STUDENTS CANNOT BE CLASSIFIED AMONG 
SCHOOLS WITHIN THE SINGLE LARGE INSTITUTIONS, BUT THEY CAN BE 
CLASSIFIED AMONG THE FOUR SEPARATE INSTITUTIONS. (JK) 
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NOTE 



With this Research Bullecin ends the collaboration over several years 
of John R* Rills, Joseph A. Klock, and Marilyn Bush Gladney. At the beginning 
of 1966 Mr. Klock left the University System of Georgia to enter study for the 
doctorate in educational research and testing at Florida State University in 
Tallahassee, Florida. On August 1, 1966, Mrs. Gladney left the Unlv^*rsity Sys- 
tem to join the Fersonnel Department of Southern Bell Telephone Company 
Atlanta to engage in selection research In tie industrial setting. On September I, 
1966, Dr. Hills leaves the University System to commence a teaching career as 
Professor of Education in the Department of Iducational Research and Testing of 
Florida State, do^ncldentally the department in which Mr. Klock is studying and 
from which Mrs. 'Gladney received her graduate degree. So, it is a sisall world, 
and we will be seeing you all again in other contexts. 
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Comparisons of^ Students in Different Schools of a large Institution 

by 

John R. Hills 
and 

1 

Marilyn B. Gladney 
Southern Bell Telephone Company 



On a college eatopus one often finds an infornoal "pecking order" among 
degree programs, majors, or schools. Some are regarded as difficult, demand- 
ing, or prestigious while others are regarded as easy or "mickey -mouse." 
Underlying these attitudes appears to be the belief that a student with a 
specified degree of academic talent would obtain substantially higher grades 
in some schools or majors than in others because it is generally easier to 
obtain high grades in certain schools. The competition is less keen, or 
grading standards are lower, or some such factor produces higher grade averages 
for given aptitude. 

Such informal hypotheses can be translated into statistical hypotheses 
in several ways. One translation is that with aptitude controlled higher 
grades by a statistically and practically significant amount will be obtained 
in some curricula^/lSian in others. An appropriate model for this translation 
is that of analysis of covariance. The hypothesis in this form states that 
among different schools there are no significant differences in standard, errors 
of estimate or in regression weights for predictor variables, but there are 
significant differences in regression constants, and these differences are 
large enough to be of practical Importance (Gulliksen 6e Wilks, 1950). 

A different translation takes the form of the statement that given in- 
formation on academic potential and grade performance of studentS|One can 
sort the students clearly (statistically and practically) into majors or schools 
The sorting is done on the basis of the level of grades obtained relative to 
the level of academic potential. The model for this translation is that of the 
multiple discriminant function (Cooley & Lohnes, 1962). The hypothesis states 
that when the variables are weighted so that their combination provides the 
greatest separation in multidimensional space among the various groups, the 
degree of separation will be both statiatically and practically al|^if leant. A 
usefully high proportion of a tudents can then be classified correctly into their 
schools or majors on the basis of the application of the jproper welghta to the 
yariablea representing academic potential and grades* 



this study was conducted while the authors were employed by the Board, of 
Regents of the University System of Georgia . 



the purpose of this study Is co detencine what Is revealed by these two 
techniques when applied to data from a situation In which the Informal hypothesis 
la held that one school Is particularly easy, perhaps even to the extent of being 
a school to which students who are In academic difficulty In other schools might 
transfer so that they may eventually graduate. The question Is, are there sta* 
tistlcally and practically significant differences among schools as revealed by 
these techniques, and what kinds of light do the different statistical approaches 
shed on the problem? 



The Bata 



The authors obtained data from several Institutions for this research. 

The primary Institution Is a large college In the southeast with one particular 
school out of 12 which seems to have a reputation for being easier than the others 
for the kind of students which the Institution admits* delated to this reputation 
«are the following facts; for an entering class which was studied in some detail, 
the group of freshmen who chose the, shall we say '*weak**, school were relatively 
small in number, fifth largest among the 12. They had the lowest SAT V score mean 
of the 12 (50 points below the mean for the total group of entering freshmen); they 
had the second to the lowest SAT M score mean of the 12, 64 points below the mean 
on SAT H of all entering freshmen; they had the second lowest high school average 
mean, 1/3 of a letter grade below the total group's mean; and they tied for the 
lowest predicted average grade of the 12 groups, 1/3 of a letter grade below the 
mean for all entrants. However, by graduation from Institution, this school 
was 3 times as large as the second largest of the 12 schools. Though less than 
half the freshmen graduated, 3 times as many people graduated from this school as 
had entered it as freshmen. It still had the second to the lowest SAT V score, 
third lowest SAT M score, lowest high school average, and lowest predicted average 
means. However, the mean senior average gr&Je of this group was up among the rest, 
only 3/100 of a letter grade below the mean senior average grade for the total 
group of survivors from the entering freshman class. These facts seem to be con- 
gruent with the popular image of this schqol as being somewhat easier than other 
schools in this institution. 

The data from this Institution which were scrutinised in this study were 
the College Board's Scholastic Aptitude Test scores (SAT ¥ and SAT M), the high- 
school average grades (HSA) , and the freshman average grades (FAC) , of the 1025 
students who completed 40 hours of work in June, 1965, after entering the Institu- 
tion as first-time freshmen the preceding fall. Each student chose one of 12 
schools to enter, and this choice is the classification variable used In this study 

For certain c<nsparisons which will be discussed later, data were gathered 
frcH# three additional colleges. These data were also for the persons who completed 
40 hours of work by June, 1965, after entering as flrat-tltae freshmen the preced- 
ing fall* For these institutions we gathered the same data with the exception of 
the school of entry, which was not relevant. One of the inatitutiona was a four- 
year coeducational college predominantly attended by Kegroea, another was a four* 
year liberai arts college predominantly attended by women, and the third waa a two- 
year coeducational Junior college predoninantly attended by Ceuceaiena. The firat 
provided 165 eaaea, the aecond provided 292 caaea, and the third provided 271 cer?a 
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An analytla of covariancfr patterned after the Gnlllksen-Wilka (1950) iiiodel 
naa the flrat appitoach to the data* (The matheioatlcal extentflon 0 of this model 
ifere accompliahed by Or. Jamea Walker of the Georgia Institute of Technology 
hfaithematica Department * The Burroughs 5500 computer program was written by 
Joseph A. Klock of Florida State University* It was used on Georgia Tech's com* 
purer*) Table 1 contains the K's, means, and S*D.'a, for the twelve groups of 
entering freshmen for SAT scores, HSil's, and FAG* a* Group 12 is the school with 
the reputation of being weak In this institution* For this entering freshman 
class it has the lowest average SAT scores and has average ESA and FAG below the 
average for the total group of i025 freshmen* 

The Gulllksen-Wilks model provides for three tests* The first is s test 
of the assumption that the standard errors of estimate in the various schools 
differ* The Chi square for this test was 27*51, significant at the *01 level 
with 11 degrees of freedom* Experience with this test has led investigators 
to suspect that it is overly sensitive, and that this assumption is not very 
critical* In these data the standard errors of estimate for the 12, schools 
ranged In aixe from *38 to *57 with a mean of *49* If one is willing to Ignore 
this degree of heterogeneity, he finds that the schools do not differ In their 
regression planes (Chi square « 41*36 with 33 degreea of freedom)* However, 



Table 1 

M's, Means, and $*D*’s for Entrants of 12 Schools 



SAT-V SAT-M HSA FAG 



School 


M 


M 


S*D. 


H 


S*D* 


M 


S*D. 


M 


S.D 


1 


74 


558 


83 


655 


67 


34 


4 


2.3 


.7 


2 


14 


529 


72 


613 


57 


28 


6 


1.9 


.5 


3 


65 


591 


76 


668 


62 


32 


5 


2.4 


.7 


4 


104 


549 


78 


650 


64 


32 


4 


2.1 


.6 


5 


142 


558 


84 


644 


65 


32 


4 


2.2 


.6 


6 


58 


532 


83 


616 


68 


31 


4 


2.0 


.6 


7 


125 


560 


77 


646 


64 


32 


4 


2.3 


.6 


8 


28 


572 


93 


643 


71 


34 


5 


2.5 


.7 


9 


66 


518 


78 


614 


65 


31 


5 


2.0 


.4 


10 


184 


559 


82 


650 


70 


32 


5 


2.2 


.6 


11 


59 


519 


78 


630 


62 


32 


4 


2.1 


.5 


12 


106 


512 


79 


582 


65 


31 


5 


2.1 


.5 


Total 


1025 


548 


83 


637 


69 


32 


4 


2.2 


.6 


II 

m 


¥' 

scores 

ranges 


rat^e from 200 to 800* 
from 0(F) to 4 .0(A) * 


HSA 


ranges 


from 0(F) to f^0(A) . 



the intercepts of the regress ipn planes for the different schools do differ sig- 
nificantly (Chi a^are » 24.79 with 11 degreea of freedom, significant at the 
lOl level), tehle 2 dieplayathf intercepts in order of else from amaUeet 
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ntg«tlve to largest negstlve^ identifying the school with which each is associated 
A 1< tge negative intercept itsplies that freshmen in this school have received low 
oollege grades relative to the level of their performance on the SAT and in high 
school > It is instructive to note that school 12 , the school thought of as liiv* 
an academically easy curriculum had the least ^negative intercept* It ap* 
peered to receive grades on the average more than one fourth of a letter grede 
higher than the most severely graded school » gi^oup 4* Nhile this tern's to support 
the notion that school 12 is perhaps easier than ^'>me of the others* the differ** 
enoe does not appear to be very large* One fourtk^ of a letter grade difference 
from the most to the least difficult schools is probably not a difference of 
great practical significance* and the schools with intercepts most similar to 
school 12* schools 3 ar^d 8* have SAT and HSA smans that caimot easily be scorned 
within this institution* (See Table !•) 

Multiple Discriminant function 

The multiple discriminant function technique as described by Cooley and 
Iiohnes (1962) was applied to these same data* (The programs presented by Cooley 
and Lohnes are written for an IBM 709 computer. They were modified at the com- 
puter center of Ceorgia State College for use with that Institution's IBM 7040.) 
The multiple discriminant function analysis yielded an P ratio of 4*7478 with 
44 and 3866 degrees of freedom, significant beyond the *0005 level. Clearly then* 
these schools can be discriminated from each other on the basis of their SAT 
scores* HSA s, and FAG's with a degree of precision that is statistically sig- 
nificant at a high level of confidence. With only four variables, only four 



Table 2 

Regression Intercepts for 12 Schools, in Order of Site 



School 


Intercept 


12 


-1.40 


8 


-1.41 


3 


-1.49 


7 


-1*53 


1 


-1*54 


11 


-1 *58 


9 


-1.58 


6 


-1*59 


5 


-1*60 


10 


-1.60 - 


2 


-1.61 


4 


-1.69 



functions can be obtained* However* in this case three of the four functions 
accounted for 98% of the discriminating power of these four variables* To see 
idiether classification on the basis of the four functions derived from this 
anilysis was accurate enough to be of practical importance* we determined what 
proportion of students would be correctly classified into the schools they had 
entered * ^Is was done on a safl^ling basis * The students, within each school 
were placed in alphabetic order* The classifications of each of the fir4t 10 
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la #«ch achooX were with their schools of entry. Only 12 of the 120 

(101) were correctly sorted by the fonr discriminant functions. Tht predominant 
type of error In classification was that the small schools were assigned even 
fewer of the students than they deserved. Hires of the larger schools, schools 
4, 10, and 12, were assigned all but 5 of the students. The other 9 schools 
•hared the remaining 5 cases . For some reason even some of the large schools 
did not have assigned to them their fair share of students. School 5 was 
assigned only one student, and school 7 was assigned none. 

To avoid the Influence of group size on the analysis, random samples 
were selected from each of the larger schools so that no school would be repre- 
sented by moi'e cases than the smallest school which had only 14 i.tudents. 

The 12 sets of 14 students were subjected to a complete discriminant function 
and classification analysis. Again the F ratio was significant beyond the 
.0005 level, its value being 2,0122 wi^-h 44 and 587 degrees of freedom. However, 
the discriminant functions in this case are not very similar to the ones obtained 
using all of the subjects. The first three functions for this analysis account 
for aly 91X of the discrimination power of the four variables. This time many 
laore students were assigned to the schools which had been under supplied by the 
analysis of all 1025 students, but the proportion of correct assignments was 
not particularly high, only 28X. 



Data With Good Discrimination 

At this point one might wonder whether the discriminant function can be 
very effective with only four variables . We decided to apply it to data from 
different institutions to see whether it could classify students correctly into 
institutions when the institutions differed to a far greater degree in SAT scores 
than did the various schools within the large Institution of our major concern. 
For this purpose we picked three additional institutions. The N’s, means, and 
standard deviations of the four variables, SAT V, SAT M, HSA, and FAG appear In 
Table 3. It can be seen in that table that there are vast differences among 



Table 3 



N's, Means, and Standard Deviations for Entrants of Four Institutions 



Institution N 

1 1025 

2 165 

3 292 

4 271 



SAT-V 




SAT 


-M 


M 


S.D. 


M 


S.D. 


548 


83 


637 


69 


271 


54 


305 


52 


438 


89 


436 


82 


419 


88 


460 


85 



HSA FAw 



H 


S.D. 


M 


S.D 


32 


4 


2.2 


.6 


25 


6 


2.2 


.5 


32 


5 


2.3 


.6 


32 


5 


2.8 


.5 



these institutions in mean SAT scores, but relatively much smaller differences 
In FAG means. For Instance, Institution 1 has SAT V and SAT M means e^ch of 
which Is on the order bf 300 points higher than those of institution 2, but tne 
mean FAG* a in the two institutions are the same. The cases of institutions 3 
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and 4 are of Interest because $AT and HSA means are rather similar, but FM' s 
in institution 4 average one half of a letter grade higher than in institution 3. 

The multiple discriminant function applied to these data yields the 
fantastically large P ratio of 362.9 with 12 and 4620 degrees of freedom. An 
P ratio of 3.15 with these degrees of freedom mould be significant at the .0005 
level . 



With four groups only three discriminant functions are obtained. The 
first function accounted for 947o of the discriminating power of the four variables. 
The second function brought the percentage to 97. The first function gave great 
positive emphasis to high school grades and lesser positive emphasis to SAT 
scores, but negative emphasis to PAG. A person would tend to be at one end of the 
distribution of scores on this function if he had high V, M, and USA but low PAG. 

He would be at the other end of the distribution if he had low predictor scores 
but received high college grades. 

In this situation the multiple discriminant function provided accurate 
classification. Of the total number of 1753 entering freshman students at these 
four institutions, 87% would be correctly assigned to the institution they 
actually entered through use of these three discriminant functions. The proportions 
of correct assignments at the four Institutions and the proportions of mlsclasslfi- 
cations from each institution to the other appear in Table 4. It can be seen 



Table 4 

Percents of Students Mlsclasslf led into Four Institutions 



# 




(Institution to Which Incorrect Classification is Hade) 


Correct Institution 


N 


1 


2 


3 


4 


Total % Mlsclasslfled 


1 


1025 


- 


0% 


2% 


1% 


2% 


2 


165 


0% 


- 


5% 


7% 


13% 


3 


292 


12% 


3% 


- 


15% 


31% 


4 


271 


9% 


7% 


21% 


- 


37% 


Total 


1753 










13% 



that very few (only 2%) of the students at the institution of our major concern 
would have been assigned to any of the other three institutions. Also, very few 
miiclassiflcatlons from other institutions would be of the nature of incorrect 
assignments of students to institution number 2* 




These data suggest, then, that the multiple discriminant function with only 
four variables, SAT V, SAT M, HSA, and PAG, can indeed do a highly effective classi- 
fication job in a situation where there are wide differences in ibean FAG*s relative to 
the other vdtiables. In these data tide differences seem to occur between institutions 
rather than between schools within lnstltu|:ion 1. Apparently the differences between 
schools in institution 1 are far less extreme than are the differences between these 
(four institutions, a fact which places the differences found In institution 1 into 
^ cl^ perspective ♦ It can be determltted that th^^ are differences aimong schools in 

grades received for a given *level*fof aptitude in institution 1. These differences 

favor school 12 within institution 1 in accord with the informal pecking order in 
that institution. However, these differences sre relstlvely smsll in the tot si sememe 
of things . . 




. ' '■ ■ ■ ; ■ . 1 

An attempt was made to determine the sizes of the differences among these 
Institutions in grades given for a particular level of aptitude through the 
*> Oulliksen-Wilks analysis of covariance. However, in this case the standard 

errors of estimate ^ere found to differ significantly, and the regression planes 
also differed significantly in slope. While one might choose to ignore heter- 
• ogenelty of standard errors, he cannot so easily overlook heterogeneity of re- 

gression weights. Such heterogeneity implies that the planes are not parallel, 
that somewhere in space the planes cross each other, and elsewhere they diverge 
at steadily increasing rates* This being the case, the distance between the 
planes varies from one part of mult id iwensibnal space to another, and a 
difference in intercepts found at one position in space may disappear at another 
position. Thus no general statement can be made about the size of the differences 
in grades relative to level of aptitude among these institutions. 



Summary 

Uaing two techniques, analysis of covariance and multiple discriminant 
function analysis, this study examines the extent to which grading , ractlces 
differ among schools within an institution Iv. which one school has a reputation 
of being particularly easy. To provide background for comparison, differences 
in grading practices relative to academic potential among four different institu- 
tions are also examined. It was found that while statistically significant 
differences in grading practices do exist among the schools of the institution 
under study, the differences are relatively small compared to the differences 
between institutions. The classification of students among the institutions can 
be done quite effectively on the basis of the grades they obtained in relation 
to their aptitude, but the classification of students into schools within the 
large institution of our study was very inaccurate. 










8 







■Nj; 

* 



R«£er«nc»t 



CooUy, W. W* & Lohnti, f . E. Ma ltivarlatt pfocedures for th» bghtvofl gciencet « 

Jlew York: Wiley* 1962. 

OuUikaett, H. 0. 6» Wilke, 8. 8. Regreiilon teete for teverel MBiplei. Peychonie trike * 
1950, 15, 91-114. 






1 
















